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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . |EI This communication is responsive to the examiner's amendment on 12/18/09. 

2. The allowed claim(s) is/are 23-30,32-39,41,43 and 45-50 . 

3. ^ Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
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1. □ Certified copies of the priority documents have been received. 

2. ^ Certified copies of the priority documents have been received in Application No. 09/413.432 . 
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International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 

EXAMINER'S AMENDMENT 

An examiner's amendment to the record appears below. Should the changes and/or 
additions be unacceptable to applicant, an amendment may be filed as provided by 37 CFR 
1.312. To ensure consideration of such an amendment, it MUST be submitted no later than the 
payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview with 
Mr. Robert T. Clarke on 12/18/09. 

The application has been amended as follows: 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listinu of Claims: 

Claims 1-22 (canceled). 

Claim 23 (currently amended): A method of attaching data items to a physical 
environment, the method comprising: 

capturing surrounding contexts in a particular physical environment, the surrounding 
contexts including at least one of position context and object context, and capturing data items 
including at least one of visual data and audio data, wherein the surrounding contexts and the 
data items are sensed by a plurality of sensing means, [[and ]] wherein the position context 
represents a position in the particular physical environment and is based on a plurality of electric 
field intensities sensed by the sensing means n iytrcd on a 
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attaching data items to the surrounding contexts; 

sending the attached data items and the captured surrounding contexts to an external 
apparatus for storing; 

transmitting the captured position context to the external apparatus for retrieving a data 
item stored in the external apparatus; and 

receiving the data item stored in the external apparatus based on the transmitted position 
context. 

Claim 24 (currently amended): T.k..[[A ]]melhod o[ [[according to ]]Claim 23, further 
comprising selecting a date and a time when attaching the data items to the surrounding contexts. 

Claim 25 (currently amended): The [[A ]]melhod of. [[according to ]]Claim 24, wherein 
the selected date and time includes IT isll a future or past date and time. 

Claim 26 (currently amended): The [ [A ]]method ^..[[according to ]]Claim 23, wherein 
the object context is for identifying at least one object in the particular physical environment. 

Claim 27 (currently amended): I|:c.[[A ]]melhod o[J [according to ]]Claim 23, wherein 
the capturing is continuously performed so that the data items are always captured. 

Claim 28 (currently amended): jj:e [[A ]]melhod ^..[[according to ]]Claim 23, wherein 
the position context identifies a room in the particular physical environment. 

Claim 29 (currently amended): J he [[A ]]method ^.'..[[according to ]]Claim 23, wherein 
the audio data mdydcs.[[is ]]voice data. 
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Claim 30 (currently amended): The {[A ]]method of [[according to ]]Claim 23, wherein 
the visual data [ [is |]image data. 

Claim 31 (canceled). 

Claim 32 (currently amended): An apparatus for attaching data items to a physical 
environment, ;] comprising: 

capturing means for capturing surrounding context in a particular physical environment, 
the surrounding contexts including at least one of position context and object context, and 
capturing data items including at least one of visual data and audio data, wherein the surrounding 
contexts and the data items are sensed by a plurality of sensing means, [[and ]]wherein the 
position context represents a position in the particular physical environment and is based on a 
plurality of electric field intensities sensed by the sensing means ■ >■ . ; 
eonio^a ;s 

eioctro^k f\ id i-: ; ; o i :U LMsi.V.i \ li ! ' N - '" QGiil'l )lKMU^iUh-} 

:Ab'cU:ic.a:;iy.£; 

attaching means for attaching data items to the surrounding contexts; 

sending means for sending the attached data items and the captured surrounding contexts 
to an external apparatus for storing; 

transmitting means for transmitting the captured position context to the external 
apparatus for retriev ing a data item stored in the external apparatus; and 

receiving means for receiving the data item stored in the external apparatus based on the 
transmitted position context. 

Claim 33 (currently amended): The [[An ]] apparatus of [[according to ]]Claim 32, 
further comprising selecting means for selecting a date and a time when attaching the data items 
to the surrounding contexts. 
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Claim 34 (currently amended): The [[An ]] apparatus of [[according to ]]Claim 33, 
wherein the selected date and time «k - lud»:x [[is ]]a 1'uturc or past date and time. 

Claim 35 (currently amended): Thc...[[An ]]apparatus of.. [[according to ]]Claim 32, 
wherein the object context is for identifying at least one object in the particular physical 
environment. 

Claim 36 (currently amended): The [[An ]] apparatus of [[according to ]]Claim 32, 
wherein the capturing is continuously performed so that the data items are always captured. 

Claim 37 (currently amended): The_[[An ]] apparatus of_[[according to ]]Claim 32, 
wherein the position context identifies a room in the particular physical environment. 

Claim 38 (currently amended): The [[An ]] apparatus of [[according to ]]Claim 32, 
wherein the audio data K.":lf ; A.LoI[i* ]]voice data. 

Claim 39 (currently amended): Th? [ [An ]] apparatus o.C..[[according to ]]Claim 32, 
wherein the visual data ■ , [[is ]] image data. 

Claim 40 (canceled). 

Claim 41 (currently amended): A method for attaching data items to a physical 
environment, the method comprising: 

capturing a plurality of surrounding contexts in a particular physical environment, the 
surrounding contexts including location data and time data, wherein the surrounding contexts are 
sensed by a plurality of sensing means, [[and ]]wherein the location data represents a position in 
the particular physical environment and is based on a plurality of electric field intensities sensed 
by the sensing means ^ ' ed from a 
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inputting keyword and data including at least one of visual data, audio data, and text data 
regarding the surrounding contexts, wherein the keyword and the data including at least one of 
the visual data, the audio data, and the text data are attached to the surrounding contexts; 

sending the location data, the time data, the keyword, and the data including at least one 
of the visual data, the audio data, and the text data to a database for storing; 

transmitting at least one of the location data, the time data, and the keyword to the 
database for retrieving the data including at least one of the visual data, the audio data, and the 
text data stored in the database; 

receiving the data including at least one of the visual data, the audio data, and the text 
data stored in the database in a result of the retrieving; and 

displaying the received data including at least one of the visual data, the audio data, and 
the text data. 

Claim 42 (canceled). 

Claim 43 (currently amended): An apparatus for attaching data items to a physical 
environment, the apparatus comprising: 

capturing means for capturing a plurality of surrounding contexts in a particular physical 
environment, the surrounding contexts including location data and time data, wherein the 
surrounding contexts are sensed by a plurality of sensing means, [[and ]]wherein the location 
data represents a position in the particular physical environment and is based on a plurality of 
electric field intensities sensed by the sensing nit ins > ;> 

l , . ) -. v N - c.i \ v. vi ; 

inputting means for inputting keyword and data including at least one of visual data, 
audio data, and text data regarding the surrounding contexts, wherein the keyword and the data 
including at least one of the visual data, the audio data, and the text data are attached to the 
surrounding contexts; 

sending means for sending the location data, the time data, the keyword, and the data 
including at least one of the visual data, the audio data, and the text data to a database for storing; 
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transmitting means lor transmitting at least one of the location data, the time data, and the 
keyword to the database for retrieving a data including at least one of visual data, audio data, and 
text data stored in the database; 

receiving means for receiving the data including at least one of the visual data, the audio 
data, and the text data stored in the database in a result of the retrieving; and 

displaying means for displaying the received data including at least one of the visual data, 
the audio data, and the text data. 

Claim 44 (canceled). 



Claim 45 (currently amended): A method for storing data items attached to surrounding 
contexts in a physical environment, the method comprising: 

receiving location data, time data, keyword, and data including at least one of visual data, 
audio data and text data from an other apparatus, w herein the location data represents a position 
in the physical en\ ironmcnl. ; ^ 



storing the location data, the time data, the keyword, and the data including at least one of 
the visual data, the audio data, and the text data in a database in a corresponding manner, 
wherein the location data, the time data, and the keyword are attached as a retrieval key for 
retrieving the data including at least one of the visual data, the audio data, and the text data; 
retrieving the database in response to a request from the other apparatus; and 
sending the data, to the other apparatus, including at least one of the visual data, the audio 
data, and the text data in a result of the retrieving. 



; Formatted: Hot Highlight 



Claim 46 (currently amended): An apparatus for storing data items attached to 
surrounding contexts in a physical environment, the apparatus comprising: 

receiving means for receiving location data, time data, keyword, and data including at 
least one of visual data, audio data and text data from an other apparatus, wherein the location 
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data represents a position in the physical environment . * o o " - s> i 

storing means for storing the location data, the time data, the keyword, and the data 
including at least one of the visual data, the audio data, and the text data in a database in a 
corresponding manner, wherein the location data, the time data, and the keyword are attached as 
a retrieval key for retrieving the data including at least one of the visual data, the audio data and 
the text data; 

retrieving means for retrieving the database in response to a request from the other 
apparatus; and 

sending means for sending the data, to the other apparatus, including at least one of the 
visual data, the audio data, and the text data in a result of the retrieving. 

Claim 47 (currently amended): lh: [[A ]]method <>;' [[according to ]] Claim 23, further 
comprising sensing an IR signal transmitted from an IR beacon located in the particular physical 
environment, wherein the position context is based on the IR signal. 

Claim 48 (currently amended): The ..[[An ]]apparatus of [[according to ]]Claim 32, 
further comprising: 

IR sensing means for sensing an IR signal transmitted from an IR beacon located in the 
particular physical environment, wherein the position context is based on the IR signal. 

Claim 49 (currently amended): Tj;:e.[[A ]]method of [[according to ]]Claim 41, further 
comprising sensing an IR signal transmitted from an IR beacon located in the particular physical 
environment, wherein the location data is based on the IR signal. 

Claim 50 (currently amended): Ik ....[[An ]] apparatus of..[ [according to ]]Claim 43, 
further comprising: 
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IR sensing means for sensing an IR signal transmitted from an IR beacon located in the 
particular physical environment, wherein the location data is based on the IR signal. 

Allowable Subject Matter 

Claims 23-30, 32-39, 41, 43, 45-50 are allowed. 

The following is an examiner's statement of reasons for allowance: Independent claims 
23, 32, 41, 43, 45 and 46, each when considered as a whole, are allowable over the prior art of 
record. Specifically prior art of record fail to clearly teach or suggest that the position context is 
based on a distance calculated from a similarity determination among pairs of an electric field 
intensity of an electric wave and a unique ID of each apparatus transmitting the electric wave. 

Any comments considered necessary by applicant must be submitted no later than the 
payment of the issue fee and, to avoid processing delays, should preferably accompany the issue 
fee. Such submissions should be clearly labeled "Comments on Statement of Reasons for 
Allowance." 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Ba Huynh whose telephone number is (571) 272-4138. The 
examiner can normally be reached on Mon - Fri. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Weilun Lo can be reached on 571-272-4847. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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